[SPARK-53585][BUILD] Upgrade Scala to 2.13.17 by vrozov · Pull Request #52509 · apache/spark

vrozov · 2025-10-02T17:45:53Z

What changes were proposed in this pull request?

Upgrade to scala 2.13.17

Why are the changes needed?

To bring the latest bug fixes and improvements like JDK 25 support. Note that Scala community announces two breaking changes due to the bug fixes.

Breaking changes

Mix in the productPrefix hash statically in case class hashCode

Improve scala.util.Using suppression order

https://github.com/scala/scala/releases/tag/v2.13.17

Does this PR introduce any user-facing change?

No

How was this patch tested?

local and github builds

Was this patch authored or co-authored using generative AI tooling?

No

vrozov · 2025-10-02T17:47:11Z

sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala

@@ -223,7 +223,7 @@ abstract class TreeNode[BaseType <: TreeNode[BaseType]]
    children.map(_.height).reduceOption(_ max _).getOrElse(0) + 1)
  def height: Int = _height()

-  private val _hashCode = new BestEffortLazyVal[Integer](() => MurmurHash3.productHash(this))
+  private val _hashCode = new BestEffortLazyVal[Integer](() => MurmurHash3.caseClassHash(this))


productHash is deprecated in 2.13.17

vrozov · 2025-10-02T17:47:40Z

sql/connect/client/jvm/pom.xml

@@ -88,7 +88,7 @@
    </dependency>
    <dependency>
      <groupId>com.lihaoyi</groupId>
-      <artifactId>ammonite_${scala.version}</artifactId>
+      <artifactId>ammonite_2.13.16</artifactId>


awaiting com-lihaoyi/Ammonite#1678

dongjoon-hyun

Nice. Thank you, @vrozov .

dongjoon-hyun · 2025-10-06T16:33:05Z

Is there any update, @vrozov ?

vrozov · 2025-10-07T02:49:31Z

@dongjoon-hyun No, still waiting for ammonite_2.13.17 to be published.

vrozov · 2025-10-12T23:47:37Z

@dongjoon-hyun upgraded ammonite to 3.0.3, please review.

dongjoon-hyun · 2025-10-12T23:58:32Z

Thank you. Please rebase to the master branch once more because Ammonite was merged already.

[SPARK-53879] Upgrade Ammonite to 3.0.3 #52577

dongjoon-hyun · 2025-10-13T00:00:53Z

sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala

@@ -223,7 +223,7 @@ abstract class TreeNode[BaseType <: TreeNode[BaseType]]
    children.map(_.height).reduceOption(_ max _).getOrElse(0) + 1)
  def height: Int = _height()

-  private val _hashCode = new BestEffortLazyVal[Integer](() => MurmurHash3.productHash(this))
+  private val _hashCode = new BestEffortLazyVal[Integer](() => MurmurHash3.caseClassHash(this))


And, please spin off this as a new PR if productHash still exists, @vrozov .

@dongjoon-hyun productHash() is deprecated:

[ERROR] [Error] /local/home/vrozov/ws/spark-sbt/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala:226: method productHash in object MurmurHash3 is deprecated (since 2.13.17): use `caseClassHash` instead Applicable -Wconf / @nowarn filters for this fatal warning: msg=<part of the message>, cat=deprecation, site=org.apache.spark.sql.catalyst.trees.TreeNode._hashCode.$anonfun, origin=scala.util.hashing.MurmurHash3.productHash, version=2.13.17

dongjoon-hyun

+1, LGTM. Thank you, @vrozov

For the other reviewers, initially, I proposed to use the existing method, MurmurHash3.productHash, via revising our compilation rules.

spark/pom.xml

Lines 2763 to 2785 in 00d2a54

    
                         <arg>-Wconf:msg=^(?=.*?method|value|type|object|trait|inheritance)(?=.*?deprecated)(?=.*?since 2.13).+$:e</arg> 
        
                         <arg>-Wconf:msg=^(?=.*?Widening conversion from)(?=.*?is deprecated because it loses precision).+$:e</arg> 
        
                         <!-- SPARK-45610 Convert "Auto-application to `()` is deprecated" to compile error, as it will become a compile error in Scala 3. --> 
        
                         <arg>-Wconf:cat=deprecation&amp;msg=Auto-application to \`\(\)\` is deprecated:e</arg> 
        
                         <!-- 
        
                           SPARK-35574 Prevent the recurrence of compilation warnings related to 
        
                           `procedure syntax is deprecated` 
        
                         --> 
        
                         <arg>-Wconf:cat=deprecation&amp;msg=procedure syntax is deprecated:e</arg> 
        
                         <!-- 
        
                           SPARK-45627 Symbol literals are deprecated in Scala 2.13 and it's a compile error in Scala 3. 
        
                         --> 
        
                         <arg>-Wconf:cat=deprecation&amp;msg=symbol literal is deprecated:e</arg> 
        
                         <!-- 
        
                           SPARK-45627 `enum`, `export` and `given` will become keywords in Scala 3, 
        
                           so they are prohibited from being used as variable names in Scala 2.13 to 
        
                           reduce the cost of migration in subsequent versions. 
        
                         --> 
        
                         <arg>-Wconf:cat=deprecation&amp;msg=it will become a keyword in Scala 3:e</arg> 
        
                         <!-- 
        
                           SPARK-49937 ban call the method `SparkThrowable#getErrorClass` 
        
                         --> 
        
                         <arg>-Wconf:cat=deprecation&amp;msg=method getErrorClass in trait SparkThrowable is deprecated:e</arg>

However, after digging the original Scala bug and fixes, it turns out that there is no way to keep the previous method because both old and new APIs are changed together.

So, I agree this AS-IS PR and @vrozov .

dongjoon-hyun · 2025-10-13T01:30:36Z

BTW, I updated the PR description (for you) because it will become our commit log, @vrozov .

dongjoon-hyun · 2025-10-13T04:18:46Z

All Scala-related tests passed.

Merged to master for Apache Spark 4.1.0-preview3.

dongjoon-hyun · 2025-10-13T04:18:55Z

Thank you again, @vrozov .

vrozov · 2025-10-13T15:47:04Z

All tests passed, looks like github issue in updating status of the check on the PR.

…Scala 2.13.17 ### What changes were proposed in this pull request? This PR aims to regenerate benchmark results after upgrading to Scala 2.13.17. ### Why are the changes needed? Since last update, we change important libraries, not only Scala, but also Hadoop, ORC, ZSTD libraries. This PR aims to make the benchmark result up-to-date as a way to detect any performance regression. - #52509 - #51127 - #52478 - #52591 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Manual review. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #52600 from dongjoon-hyun/SPARK-53893. Lead-authored-by: Dongjoon Hyun <dongjoon@apache.org> Co-authored-by: dongjoon-hyun <dongjoon-hyun@users.noreply.github.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>

vrozov · 2025-10-24T15:51:06Z

Thank you @dongjoon-hyun!

### What changes were proposed in this pull request? Upgrade to scala 2.13.17 ### Why are the changes needed? To bring the latest bug fixes and improvements like JDK 25 support. Note that Scala community announces two breaking changes due to the bug fixes. > Breaking changes > - Mix in the productPrefix hash statically in case class hashCode > - Improve scala.util.Using suppression order - https://github.com/scala/scala/releases/tag/v2.13.17 - scala/scala#11046 - scala/scala#10937 - scala/scala#10927 - scala/bug#13058 - scala/scala#11023 - scala/bug#13033 - scala/scala#11000 ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? local and github builds ### Was this patch authored or co-authored using generative AI tooling? No Closes apache#52509 from vrozov/SPARK-53585. Authored-by: Vlad Rozov <vrozov@amazon.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>

…Scala 2.13.17 ### What changes were proposed in this pull request? This PR aims to regenerate benchmark results after upgrading to Scala 2.13.17. ### Why are the changes needed? Since last update, we change important libraries, not only Scala, but also Hadoop, ORC, ZSTD libraries. This PR aims to make the benchmark result up-to-date as a way to detect any performance regression. - apache#52509 - apache#51127 - apache#52478 - apache#52591 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Manual review. ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#52600 from dongjoon-hyun/SPARK-53893. Lead-authored-by: Dongjoon Hyun <dongjoon@apache.org> Co-authored-by: dongjoon-hyun <dongjoon-hyun@users.noreply.github.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

| Cause | Type | Category | Description | Affected Files | |-------|------|----------|-------------|----------------| | - | Feat | Feature | Introduce Spark41Shims and update build configuration to support Spark 4.1. | pom.xml shims/pom.xml shims/spark41/pom.xml shims/spark41/.../META-INF/services/org.apache.gluten.sql.shims.SparkShimProvider shims/spark41/.../spark41/Spark41Shims.scala shims/spark41/.../spark41/SparkShimProvider.scala | | [#51477](apache/spark#51477) | Fix | Compatibility | Use class name instead of class object for streaming call detection to ensure Spark 4.1 compatibility. | gluten-core/.../caller/CallerInfo.scala | | [#50852](apache/spark#50852) | Fix | Compatibility | Add printOutputColumns parameter to generateTreeString methods | shims/spark41/.../GenerateTreeStringShim.scala | | [#51775](apache/spark#51775) | Fix | Compatibility | Remove unused MDC import in FileSourceScanExecShim.scala | shims/spark41/.../FileSourceScanExecShim.scala | | [#51979](apache/spark#51979) | Fix | Compatibility | Add missing StoragePartitionJoinParams import in BatchScanExecShim and AbstractBatchScanExec | shims/spark41/.../v2/AbstractBatchScanExec.scala shims/spark41/.../v2/BatchScanExecShim.scala | | [#51302](apache/spark#51302) | Fix | Compatibility | Remove TimeAdd from ExpressionConverter and ExpressionMappings for test | gluten-substrait/.../ExpressionConverter.scala gluten-substrait/.../ExpressionMappings.scala | | [#50598](apache/spark#50598) | Fix | Compatibility | Adapt to QueryExecution.createSparkPlan interface change | gluten-substrait/.../GlutenImplicits.scala shims/spark*/.../QueryExecutionShim.scala | | [#52599](apache/spark#52599) | Fix | Compatibility | Adapt to DataSourceV2Relation interface change | backends-velox/.../ArrowConvertorRule.scala shims/spark*/.../v2/DataSourceV2RelationShim.scala | | [#52384](apache/spark#52384) | Fix | Compatibility | Using new interface of ParquetFooterReader | backends-velox/.../ParquetMetadataUtils.scala gluten-ut/spark40/.../parquet/GlutenParquetRowIndexSuite.scala shims/spark*/.../parquet/ParquetFooterReaderShim.scala | | [#52509](apache/spark#52509) | Fix | Build | Update Scala version to 2.13.17 in pom.xml to fix `java.lang.NoSuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` | pom.xml | | - | Fix | Test | Refactor Spark version checks in VeloxHashJoinSuite to improve readability and maintainability | backends-velox/.../VeloxHashJoinSuite.scala | | [#50849](apache/spark#50849) | Fix | Test | Fix MiscOperatorSuite to support OneRowRelationExec plan Spark 4.1 | backends-velox/.../MiscOperatorSuite.scala | | [#52723](apache/spark#52723) | Fix | Compatibility | Add GeographyVal and GeometryVal support in ColumnarArrayShim | shims/spark41/.../vectorized/ColumnarArrayShim.java | | [#48470](apache/spark#48470) | 4.1.0 | Exclude | Exclude split test in VeloxStringFunctionsSuite | backends-velox/.../VeloxStringFunctionsSuite.scala | | [#51259](apache/spark#51259) | 4.1.0 | Exclude | Only Run ArrowEvalPythonExecSuite tests up to Spark 4.0， we need update ci python to 3.10 | backends-velox/.../python/ArrowEvalPythonExecSuite.scala |

| Cause | Type | Category | Description | Affected Files | |-------|------|----------|-------------|----------------| | - | Feat | Feature | Introduce Spark41Shims and update build configuration to support Spark 4.1. | pom.xml shims/pom.xml shims/spark41/pom.xml shims/spark41/.../META-INF/services/org.apache.gluten.sql.shims.SparkShimProvider shims/spark41/.../spark41/Spark41Shims.scala shims/spark41/.../spark41/SparkShimProvider.scala | | [#51477](apache/spark#51477) | Fix | Compatibility | Use class name instead of class object for streaming call detection to ensure Spark 4.1 compatibility. | gluten-core/.../caller/CallerInfo.scala | | [#50852](apache/spark#50852) | Fix | Compatibility | Add printOutputColumns parameter to generateTreeString methods | shims/spark41/.../GenerateTreeStringShim.scala | | [#51775](apache/spark#51775) | Fix | Compatibility | Remove unused MDC import in FileSourceScanExecShim.scala | shims/spark41/.../FileSourceScanExecShim.scala | | [#51979](apache/spark#51979) | Fix | Compatibility | Add missing StoragePartitionJoinParams import in BatchScanExecShim and AbstractBatchScanExec | shims/spark41/.../v2/AbstractBatchScanExec.scala shims/spark41/.../v2/BatchScanExecShim.scala | | [#51302](apache/spark#51302) | Fix | Compatibility | Remove TimeAdd from ExpressionConverter and ExpressionMappings for test | gluten-substrait/.../ExpressionConverter.scala gluten-substrait/.../ExpressionMappings.scala | | [#50598](apache/spark#50598) | Fix | Compatibility | Adapt to QueryExecution.createSparkPlan interface change | gluten-substrait/.../GlutenImplicits.scala shims/spark\*/.../shims/spark\*/Spark*Shims.scala | | [#52599](apache/spark#52599) | Fix | Compatibility | Adapt to DataSourceV2Relation interface change | backends-velox/.../ArrowConvertorRule.scala | | [#52384](apache/spark#52384) | Fix | Compatibility | Using new interface of ParquetFooterReader | backends-velox/.../ParquetMetadataUtils.scala gluten-ut/spark40/.../parquet/GlutenParquetRowIndexSuite.scala shims/spark*/.../parquet/ParquetFooterReaderShim.scala | | [#52509](apache/spark#52509) | Fix | Build | Update Scala version to 2.13.17 in pom.xml to fix `java.lang.NoSuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` | pom.xml | | - | Fix | Test | Refactor Spark version checks in VeloxHashJoinSuite to improve readability and maintainability | backends-velox/.../VeloxHashJoinSuite.scala | | [#50849](apache/spark#50849) | Fix | Test | Fix MiscOperatorSuite to support OneRowRelationExec plan Spark 4.1 | backends-velox/.../MiscOperatorSuite.scala | | [#52723](apache/spark#52723) | Fix | Compatibility | Add GeographyVal and GeometryVal support in ColumnarArrayShim | shims/spark41/.../vectorized/ColumnarArrayShim.java | | [#48470](apache/spark#48470) | 4.1.0 | Exclude | Exclude split test in VeloxStringFunctionsSuite | backends-velox/.../VeloxStringFunctionsSuite.scala | | [#51259](apache/spark#51259) | 4.1.0 | Exclude | Only Run ArrowEvalPythonExecSuite tests up to Spark 4.0， we need update ci python to 3.10 | backends-velox/.../python/ArrowEvalPythonExecSuite.scala |

github-actions bot added SQL BUILD DOCS CONNECT labels Oct 2, 2025

vrozov commented Oct 2, 2025

View reviewed changes

dongjoon-hyun reviewed Oct 2, 2025

View reviewed changes

vrozov force-pushed the SPARK-53585 branch from 9dd96f5 to b7935a9 Compare October 12, 2025 23:45

github-actions bot removed the CONNECT label Oct 12, 2025

vrozov marked this pull request as ready for review October 12, 2025 23:46

dongjoon-hyun reviewed Oct 13, 2025

View reviewed changes

[SPARK-53585][BUILD] Upgrade Scala to 2.13.17

55bbe72

vrozov force-pushed the SPARK-53585 branch from b7935a9 to 55bbe72 Compare October 13, 2025 00:17

dongjoon-hyun approved these changes Oct 13, 2025

View reviewed changes

dongjoon-hyun closed this in 3ac4a48 Oct 13, 2025

dongjoon-hyun mentioned this pull request Oct 14, 2025

[SPARK-53893][TESTS] Regenerate benchmark results after upgrading to Scala 2.13.17 #52600

Closed

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 17, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

01c2ed1

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 17, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

d04ca39

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 22, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

ee5e396

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 22, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

786edb4

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 22, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

f9684ed

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 23, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

5c3e825

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 23, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

69bfeae

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 23, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

2709350

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 23, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

09036a2

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 23, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

c3abdba

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 23, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

7942151

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 23, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

b0175e0

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 24, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

ffd1376

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 25, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

163f907

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 25, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

3d3c2d0

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 29, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

b56f9f9

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 30, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

d33198a

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 31, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

b2071a5

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Dec 31, 2025

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

be260b1

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Jan 4, 2026

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

4640ec5

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen added a commit to baibaichen/gluten that referenced this pull request Jan 4, 2026

[Fix] Update Scala version to 2.13.17 in pom.xml to fix `java.lang.No…

6228d63

…SuchMethodError: 'java.lang.String scala.util.hashing.MurmurHash3$.caseClassHash$default$2()'` see apache/spark#52509

baibaichen mentioned this pull request Jan 5, 2026

[GLUTEN-11346][CORE][VL] Add Spark 4.1 Shim Layer apache/incubator-gluten#11347

Merged

	<arg>-Wconf:msg=^(?=.?method\|value\|type\|object\|trait\|inheritance)(?=.?deprecated)(?=.*?since 2.13).+$:e</arg>
	<arg>-Wconf:msg=^(?=.?Widening conversion from)(?=.?is deprecated because it loses precision).+$:e</arg>
	<!-- SPARK-45610 Convert "Auto-application to `()` is deprecated" to compile error, as it will become a compile error in Scala 3. -->
	<arg>-Wconf:cat=deprecation&msg=Auto-application to \`\(\)\` is deprecated:e</arg>
	<!--
	SPARK-35574 Prevent the recurrence of compilation warnings related to
	`procedure syntax is deprecated`
	-->
	<arg>-Wconf:cat=deprecation&msg=procedure syntax is deprecated:e</arg>
	<!--
	SPARK-45627 Symbol literals are deprecated in Scala 2.13 and it's a compile error in Scala 3.
	-->
	<arg>-Wconf:cat=deprecation&msg=symbol literal is deprecated:e</arg>
	<!--
	SPARK-45627 `enum`, `export` and `given` will become keywords in Scala 3,
	so they are prohibited from being used as variable names in Scala 2.13 to
	reduce the cost of migration in subsequent versions.
	-->
	<arg>-Wconf:cat=deprecation&msg=it will become a keyword in Scala 3:e</arg>
	<!--
	SPARK-49937 ban call the method `SparkThrowable#getErrorClass`
	-->
	<arg>-Wconf:cat=deprecation&msg=method getErrorClass in trait SparkThrowable is deprecated:e</arg>

Conversation

vrozov commented Oct 2, 2025 • edited by dongjoon-hyun Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

Was this patch authored or co-authored using generative AI tooling?

Uh oh!

vrozov Oct 2, 2025

Choose a reason for hiding this comment

Uh oh!

vrozov Oct 2, 2025

Choose a reason for hiding this comment

Uh oh!

dongjoon-hyun left a comment

Choose a reason for hiding this comment

Uh oh!

dongjoon-hyun commented Oct 6, 2025

Uh oh!

vrozov commented Oct 7, 2025

Uh oh!

vrozov commented Oct 12, 2025

Uh oh!

dongjoon-hyun commented Oct 12, 2025

Uh oh!

dongjoon-hyun Oct 13, 2025

Choose a reason for hiding this comment

Uh oh!

vrozov Oct 13, 2025

Choose a reason for hiding this comment

Uh oh!

dongjoon-hyun left a comment

Choose a reason for hiding this comment

Uh oh!

dongjoon-hyun commented Oct 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

dongjoon-hyun commented Oct 13, 2025

Uh oh!

dongjoon-hyun commented Oct 13, 2025

Uh oh!

vrozov commented Oct 13, 2025

Uh oh!

vrozov commented Oct 24, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

vrozov commented Oct 2, 2025 •

edited by dongjoon-hyun

Loading

dongjoon-hyun commented Oct 13, 2025 •

edited

Loading